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ABSTRACT 

The effects of prenotif ication, ink color , and return 
deadline on sincerity and rates of response to mailed questionnaires 
concerning desirable characteristics of teachers were investigated in 
Thailand- Questionnaires were mailed to 800 public secondary school 
teachers in Bangkok. Some teachers received prenotif ication of the 
survey by mail, while others did not. The 100-item questionnaires 
were printed in blue, black, green, or red ink. For some 
questionnaires, a response rate was specified; others asked for 
return as soon as possible. The first mailing included a cover 
letter, the questionnaire, and a stamped self-addressed return 
envelope. The first follow-up was a reminder card. The second 
follow-up included a cover letter, a second copy of the 
questionnaire, and a stamped self-addressed return envelope. The 
first follow-up was sent 4 weeks after the initial mailing, and the 
second follow-up was sent 2 weeks after the first follow-up. The 
response rate of the initial mailing was 71.4%. The overall return 
rate was 94.9% (759 questionnaires). Sincerity of responses was 
judged by consistency in responding to eight pairs of parallel items 
measuring desirable characteristics of teachers. Significant main 
effects were found only for prenotif ication and ink color (blue and 
green) , both of which were effective in increasing response rates and 
sincerity of responses at the initial mailing. Four tables present 
response data, and a map of Southeast Asia is provided. (SLD) 
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Abstract 

This study investigated tf»e effects of prenot if icat ion, ink 
color and return deadline on response rates and sincerity of 
responses of mailed questionnaires. Eight hundred questionnaires 
were mailed to public secondary school teachers in the Bangkok 
Metropolis. The overall return rate was 94.9*. Significant main 
effects were found only for prenot i f i cat i on and ink color. Results 
suggest that prenot if icat ion and ink color, as defined in this 
study, are effpctive in increasing response rates and sincerity of 
responses . 



Introduction 

Mailed questionnaires have been avid continue to be widely 
used as means of data collection in educational research and social 
scionte research, largely due to th« convenience and to the 
.•elatively low expense involved. However, information obtained by 
using mailed quesi ionnaires is not useful unless an acceptable 
response rete and sinceritv D f responses are achieved. In this 
research, sincerity of -esponses is defined as the consistency of 
responding to 8 pairs of parallel items measuring desirable charac- 
teristics of tearhers. The measurement of sincerity of responses as 
defined above was found to be effective (Popham, 198?; Buabarn, 1980). 

Factors effecting response rates to mailed questionnaires 
have been reviewed by several authors (for example $ Heberlin and 
Rawngartner, 1978$ Goyder, 1982) and include variables such as sample 
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characteristics, questionnaire character i sties, sponsorship, and 
personalization. A recent review of survey design effects on 
resopnse rates indicates that personalization has a positive effect 
on responding (Yu and Cooper, 1983). Prenotif ication of potential 
respondents is one type of personalization conveying a sense of 
personal involvement on the part of the researcher. Heaton (1965) 
suggested that prenotif i nations are effective because they serve to 
introduce the research* r the potential re? pendent s. ••,».. 
theoretical explanation was proposed by Ajzen and Fishbein (1*80). 
Intention (to return questionnaire with sincere answers, in this 
cafe*/ i- the constru. « » \,M mediates between attitude toward -^H 
behavior in responding U- mailed questionnaires. According to their 
theory of Reasoned Action, intention is hypothesized due to tf.p 
individual attitude townrd b% havior and the expectations the person 
perceives others to hold about the behavior. Variables that effect 
either attitude or perceived expectations will effect respoive r»u- 
and also sincerity of responses. In this case, prenotif icat n>n ,■ 
an especially fruitful form of personalization is a variahl^ Uiat 
influence- the potential respondent's perceptions of the research 
expectations. Thus, it is expected that prenotif ication will 
increase the rate of return and also the quality of responses. 

ink color is the second variable that may effect the 
response rate and also sincere answers of responses. in general, 
the most highly preferred surface color, for adults appear to be red 
and blue. Green is also ranked high. Generally ranked lowest ar<=> 
violet, orange, and yellow (Fleming and Levi^, 1978). Matteson . 1974) 
disclosed that no significant differences in rate of return were 
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found among the groups receiving the semipersona 1 Ietter f while among 
the groups receiving the form letter a significantly greater number 
of colored questionnaires were returned. !n this researchi it is 
hypothesized that the response rates and sincerity of responses of 
the red, blue and green ink color questionnaires are higher than 
those »»f black ones. 

Return deadline is the third variable chosen* Henry <1975) 
found that the response rate of the nan- spec if i cat ion return group 
■.'T».o% .v.i;« hither than that of the specification return deadline* 
group (18*6%)* -Jamornmern (1987) suggests that it is wise to specify 
oti the questionnaire "please return immed lately" rather than 
>P».'i i f y ) ng ex«±«:t dates, it is exp^i ted that return deadline ui 
mailed questionnaire may be one of the variables that would increase 
not i.mlv tho quant. ity but also quality of survey responses* 

in nummary, this study was designed to determine the 
effect c -*t' pr*»ncit. if .cation, ink color* and return deadline on 
r-i?f.pi.iii« k ria'.f.. and sincerity of responses of mailed questionnaires 
«.o?.» • r*:.5iiv . i rahle characteristics of teachers* Consistent with 
tiit- th»-i.»ret rh 1 perspectives and previous research* the following 
r^M^rt. h hypotheses were formulated and tested in this study: 

1* : h*- response rate., and sincerity of responses of the 
pi enut i r ii.dt ion qup&rt iunnaired a?^ significantly higher than those of 
noj i -prenot i f i cat i on ones • 

2. The response rates and sincerity of responses of the 
red. blue and green ink color questionnaires were significantly 
higher * liaii those of Mack ones. 
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3. The response rates and sincerity of responses of the 
non~specif ication return questionnaires are significantly higher 
than that of the specification return deadline ones. 

Method 

Subjects 

Subject s wer*- pub 1 i i sec undar. schou 1 1 hers in the 
Bangkok Metropolis* Eight hundred names were randomly selected by 
means of multistage random sampling from a population of 14,336 
public, secondary school teacher?, • The questionnaires wi-i *< mailed to 
the subjects* A total of 759 or 94.9% returned the romp let ed 
questionnaires. Thv response rate at the initial mail in." was 71.4% 

Procedure 

The questionnaire used in this study had .00 four-point 
rating S'-al* items including 8 parallel items, on six pas»'^ (double- 
sided) • The length of time for survey completion was approximately 
20 mi nutes • The quest i onna i re was concerned with des i r ab 1 e 
characteristics of teachers. Tl*e alpha coefficient of the 
questionnaire was .72. 

Three experimental treatments were employed in this research. 
They were C a > prenot i f i cat i on ( prenot i f i ed versus non- prenot i f i ed > 
ih) ink color (Black* Blue, Green and Red) and (c) Return deadline 
(Specified versus ncor&pct if ied> 
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Questionnaires were coded in the upper-right corner of the 
form to allow identification of respondents. The first mailing 
consisted of a cover letter, questionnaire, and a stamped, self- 
addressed return envelope. The first follow-up was a reminder card. 
The second follow-up consisted of a covering letter with a second 
copy of the quest lonna ire and a stamped, self -addressed return 
envelope. rhe first fol low-up was sent after 4 weeks after the 
initial mailing and the second follow-up sent 2 weeks later. The 
overall response rete was 71.4% at the initial mailing and 23.5% to 
the follow-up mail.ng. 

Two analyses were performed. Response rate was tested by 
Tukey's Test for Nonaddit ivity . and ih, n transformed by using AriMn,- 
transformation. Then, a 2 x A x 2 factorial design was performed 
with Response rate as the dependent variable (Winer, 1971) The 
second was a 2 x 4 x 2 factorial design with sincerity of 
responses (scored from 0 to 8) as the dependent variable. Z-test and 
i-hfffe were post hoc analyses used in this study. 
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Results 

Effects of prenotif ication ink color and return deadline on response 
rates 

Data in Table 1 shows that the response rates of the 
prenot i f i cat i on questionnaires were higher than those of the non- 
prenot i f i cat i on ones. The response rates of the blue ink color 
ranked the? highest while the response rates of the black ink color 

qner*t ionn:«i rr^ were the lowest • The response r*f of thf* 
specification and non-specif ication return deadline questionnaires 
were slightly different, 

Ffiirn t*M<* £. Artova wa^ applied to ti-'f. f.hr> pr- re-arch 
hypotheses. It was found that prenotif ication and ink color had a 
significant effect on response rates only at the initial mailing. 
Post hue analysis farther indicated that the rer-ponse rates of the 
prenot if ication questionnaires were higher than those of the 
nori-prcriiut if i rat ion ones. The response rated of the hi up and green 
ink color questionnaires were significantly higher than t**or-e of the 
red and black ones. 
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TaLle 1 Response Rates of fr*~4]ed Qestionnai res Classified by 
Variables namely « Prenot if icat ion» Ink Color and Return 
Deadl ine 



Fo 1 1 ow-up per i od 



Variables 



Prenot i f i cat i on 
Prenot if ied 



CD = ^00) 



Non-prenotif ied In •- 400) 
I III" Co lot* 

Slack in = 200) 

Blue <n = 200) 

Greei * < n - 200 ) 

Red 'n = 200) 
Return Deadline 

Specified <n = 400 5 

IU 'i j spt'<.. i f i » j d 1 i , I. V • 



Initial mailing Follow-up mailing 
No. X No. % 



309 77.25 
262 65.50 



1 14 
170 
157 
130 

278 

2yj 



57.00 
85.00 

78 . 50 

65.00 

69.50 

73.25 



383 
376 

186 
194 
190 
189 

373 
386 



95.75 
94.00 

93.00 
97.00 
95 . 00 
94.50 

93.25 
46. 50 



Total <n = 800) 



571 



71.38 



759 



94. P8 
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Table 2 Analysis of Variance Summary Table Showing the effects of 
prenotif icat ion* ink color and return deadline on response 
rates of mailed quest ionnai red • 



Follow-up Period Initial mailing Follow-up mailing 

Source of Variation df F F 



PtM'TH'it i f icat ion ' P > 

Ink Color ( !C> 

Return Dead line 'RD) 

Px IC 

PxKD 

ICxRD 

Px JCxKM 

Nonaddi tivity 
9h 1 an-' * 

V ■ .03 



1 4 i S.0R"" ,?.*i4 

3 52.64"" 2.22 

1 4 . 59 0 . S9 

3 . 1 a fl . 3;.' 

1 1.65 0.45 

3 0.4G 0.73 
3 

1 0.01 0.08 

9 



o 

ERIC 



10 



10 



Effects of prenotif icotion. ink color and return deadline on 
sincerity of responses 

Table 3 shows the means and standard diviations of sincerity 
of responses classified by the experimental variables 
< prenot i f i cat i on ink color and return deadline'. The means of the 
sincerity of responses in each subgroup at the initial mailing 
ranged frum 4.07 to 7.11. While they ranged from 4,13 to 6.18 at 
the follow-up mailing. Results from Table / indicate that 
prenotif ica* ion and ink u>lor had significant effects ■ incerity 

of responses at the initial mailing. Post hoc analyses further 
indicated that the sincerity of responses on the prenot i ficat ion 
group wer»> > tgnif ioantly higher than those ;.f the 
^on- prenot i ficat ion group. The sincerity of responses of the blue 
and green ink color questionnaires were significantly higher than 
those of the red and black ones. At the follow-up mailing, the 
prenotif ication ♦.?*-> only experimental variable tha« -Mil had 

significant. eftV< f on sincerity of responses of mailed 
quest, ionna i r^y . 
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Table 3 Statistical Baseline Data of Sincerity of Response 

classified by Variables Namely, Prenot if icati on, Ink 
Color and Return Deadline. 



Initial Ma i 1 i ug 



Prenot i - 




Prenot i f ied 




1 


Prenot i - 


Non-Prenot i f i ed 






t i cat ion 


Deadl ine 


Deed 1 i ne 


Ncm- 


Heat ion 


Dead 1 i ne 


Deadl ine 


Non- 




Specif ied 


Specified 




Specif ied 


S pec i f i ed 


j iik Co 1 or 


N 


X 


SD 


N 


X 


sn 


Ink Color 


N 


X 


SD 


N 


X 


nn 


Black 


31 


5.91 


0.94 


30 


5.81 


l .01 


Black 


2? 


4 .04 


1 .44 


28 


4.18 


1.61 




4G 


7.01 


0.88 


48 


7.11 




Rim* 


38 


6.41 


0.82 


38 


6.61 


»1. i • 


Greei i 


39 


6.79 


0.76 


42 


7.04 


0.91 


Green 


36 


6.25 


0.95 


40 


6.07 


1 . 06 


Red 

. . J 


37 


5.66 


1.05 


36 


5.71 


0.84 


Red 


26 


4. 16 


1.12 


31 


4.07 


0.9* 


Follow-up Mailing 























Black 


15 


5.31 


0.98 


18 


4.41 


0.56 


Black 


19 


4.50 


0,58 


20 


4.75 




0.96 


Blue 


3 


6. 18 


0.71 


5 


6.04 


1.01 


Blue 


9 


5.66 


1.16 


8 


5.99 


0.70 


Green 


8 


6.01 


0.81 


7 


6.11 


0.98 


Green 


11 


5.68 


1.24 


7 


5.91 


0.89 


Red 


11 


5.03 

1 


0.97 


12 


4.61 


0.97 


Red 


19 


4. 13 


1.04 


17 


4.67 


0.58 
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Table 4 Analysis of Varience Summary Table showing the effects 

of Prenotif ication. Ink cclor and Return Deadline on 
Sincerity of Responses, 



Follow-up Period 

Source of initial Mailing Follow-up Mail in? 

Variation df F df F 



^ I 

IC 3 

RD 1 

PxIO 3 

PxRD 1 

ICxRD 3 

PxICxRD 3 

Within Cel Is 544 



"% < .01 



36.76" 1 11.40" 

3 2.60 

2 » 67 1 1 . g4 

2.59 3 4.99" 

3.72 1 1# 73 

I .32 3 0,3] 

2.91 3 2.39 
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Discussion 

The overall response rate (94 ,9X2 and the response nate at 
the initial mai 1 ing CTl .4%) of public school teachers in the 
Bangkok Metropolis to mailed questionnaires were at the upper end of 
an acceptable limit* Consistent with previous research (Green and 
Kvidahl, 1989; Dillman et.al, 1984) and the research hypotheses, at 
the initial mailing prenotif ication and ink color had significant 
effects on response rates and s*ncerity of responses. This finding, 
consistent with Dillman et al» (1984), suggests that the effects of 
personalization may be greater when on follow-up mailing is intended. 

No significant effects of prenotif ication and ink color on 
response rates were found on the follow-up mailing. This may be 
because the follow-up technique used in this study was vury 
effective. Thus, the response rate in each subgroup almost hit the 
ceiling O90X) 

It was found that the response rates and sincerity of 
responses of the blue and green ink color questionnaires were 
significantly higher than those of the red and black ones. Subjects 
preferred cool colors (blue and green) to the stronger oleoma or rod 
(Tinker and Patterson, 1969) . Thus, the cool colors appear to 
increase the response rate and sincere answers of mailed 
quest i onna i res » 

Contrary to the third research hypothesis, the response 
rates and sincerity of responses of the specification return 
deadline questionnaires did not differ significantly from those of 
the non-specification return deadline questionnaires. Both types of 
return deadline had some advantages and disadvantages. Beyond the 
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dates specified* the subjects may stop responding to the survey. 
For the non-specification return deadline group* they felt daliged 
to answer the (railed questionnaires. Thus* the return deadline 
(specified versus non-spec if ied) did not affect on response rates 
and sincerity of responses of mailed questionnaires. 

Prenotif ication was the only variable that had significant 
effects on the sincerity of responses at both the initial mailing 
and the follow-up mai 1 ing. Thus* prenotif ication increased survey 
return and also increased sincerity of answers of mailed 
questionnaires. if response rates with sincere answers are to be 
maximized* prenotif ication* ink col or (blue or green) and repeated 
follow-up seem in order . 
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THE COUNTRY 



Thailand (formerly Siam) is a tropical country situated in the centre of mainland 
Southeast Asia. The principal geographical feature of the country which covers 
most of its area of 196,455 square miles ( 514,000 square kilometres) consists of 
mountain ranges in the north, west, south and east, and plain in the central part 
which is the main populated area and the base of the country's economy. The 
mountain chain in the west separates Thailand from Burma and trails down the 
spine oi the extended peninsula to the southern border with West Malaysia. The 
northeast is bound by the Mekong River, forming the frontier with Laos, while the 
eastern part of the country is separated from Cambodia by mountain chains. 
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Figure 1.1: The map of Southeast Asia 
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